Your browser doesn't support javascript.
loading
Show: 20 | 50 | 100
Results 1 - 20 de 26
Filter
1.
JAMIA Open ; 6(4): ooad096, 2023 Dec.
Article in English | MEDLINE | ID: mdl-38028730

ABSTRACT

Objective: Developing accurate phenotype definitions is critical in obtaining reliable and reproducible background rates in safety research. This study aims to illustrate the differences in background incidence rates by comparing definitions for a given outcome. Materials and Methods: We used 16 data sources to systematically generate and evaluate outcomes for 13 adverse events and their overall background rates. We examined the effect of different modifications (inpatient setting, standardization of code set, and code set changes) to the computable phenotype on background incidence rates. Results: Rate ratios (RRs) of the incidence rates from each computable phenotype definition varied across outcomes, with inpatient restriction showing the highest variation from 1 to 11.93. Standardization of code set RRs ranges from 1 to 1.64, and code set changes range from 1 to 2.52. Discussion: The modification that has the highest impact is requiring inpatient place of service, leading to at least a 2-fold higher incidence rate in the base definition. Standardization showed almost no change when using source code variations. The strength of the effect in the inpatient restriction is highly dependent on the outcome. Changing definitions from broad to narrow showed the most variability by age/gender/database across phenotypes and less than a 2-fold increase in rate compared to the base definition. Conclusion: Characterization of outcomes across a network of databases yields insights into sensitivity and specificity trade-offs when definitions are altered. Outcomes should be thoroughly evaluated prior to use for background rates for their plausibility for use across a global network.

2.
Drug Saf ; 46(12): 1335-1352, 2023 Dec.
Article in English | MEDLINE | ID: mdl-37804398

ABSTRACT

INTRODUCTION: Individual case reports are the main asset in pharmacovigilance signal management. Signal validation is the first stage after signal detection and aims to determine if there is sufficient evidence to justify further assessment. Throughout signal management, a prioritization of signals is continually made. Routinely collected health data can provide relevant contextual information but are primarily used at a later stage in pharmacoepidemiological studies to assess communicated signals. OBJECTIVE: The aim of this study was to examine the feasibility and utility of analysing routine health data from a multinational distributed network to support signal validation and prioritization and to reflect on key user requirements for these analyses to become an integral part of this process. METHODS: Statistical signal detection was performed in VigiBase, the WHO global database of individual case safety reports, targeting generic manufacturer drugs and 16 prespecified adverse events. During a 5-day study-a-thon, signal validation and prioritization were performed using information from VigiBase, regulatory documents and the scientific literature alongside descriptive analyses of routine health data from 10 partners of the European Health Data and Evidence Network (EHDEN). Databases included in the study were from the UK, Spain, Norway, the Netherlands and Serbia, capturing records from primary care and/or hospitals. RESULTS: Ninety-five statistical signals were subjected to signal validation, of which eight were considered for descriptive analyses in the routine health data. Design, execution and interpretation of results from these analyses took up to a few hours for each signal (of which 15-60 minutes were for execution) and informed decisions for five out of eight signals. The impact of insights from the routine health data varied and included possible alternative explanations, potential public health and clinical impact and feasibility of follow-up pharmacoepidemiological studies. Three signals were selected for signal assessment, two of these decisions were supported by insights from the routine health data. Standardization of analytical code, availability of adverse event phenotypes including bridges between different source vocabularies, and governance around the access and use of routine health data were identified as important aspects for future development. CONCLUSIONS: Analyses of routine health data from a distributed network to support signal validation and prioritization are feasible in the given time limits and can inform decision making. The cost-benefit of integrating these analyses at this stage of signal management requires further research.


Subject(s)
Drug-Related Side Effects and Adverse Reactions , Pharmacovigilance , Humans , Adverse Drug Reaction Reporting Systems , Drug-Related Side Effects and Adverse Reactions/epidemiology , Databases, Factual , Netherlands
3.
Front Pharmacol ; 14: 1118203, 2023.
Article in English | MEDLINE | ID: mdl-37033631

ABSTRACT

Background: Thrombosis with thrombocytopenia syndrome (TTS) has been identified as a rare adverse event following some COVID-19 vaccines. Various guidelines have been issued on the treatment of TTS. We aimed to characterize the treatment of TTS and other thromboembolic events (venous thromboembolism (VTE), and arterial thromboembolism (ATE) after COVID-19 vaccination and compared to historical (pre-vaccination) data in Europe and the US. Methods: We conducted an international network cohort study using 8 primary care, outpatient, and inpatient databases from France, Germany, Netherlands, Spain, The United Kingdom, and The United States. We investigated treatment pathways after the diagnosis of TTS, VTE, or ATE for a pre-vaccination (background) cohort (01/2017-11/2020), and a vaccinated cohort of people followed for 28 days after a dose of any COVID-19 vaccine recorded from 12/2020 onwards). Results: Great variability was observed in the proportion of people treated (with any recommended therapy) across databases, both before and after vaccination. Most patients with TTS received heparins, platelet aggregation inhibitors, or direct Xa inhibitors. The majority of VTE patients (before and after vaccination) were first treated with heparins in inpatient settings and direct Xa inhibitors in outpatient settings. In ATE patients, treatments were also similar before and after vaccinations, with platelet aggregation inhibitors prescribed most frequently. Inpatient and claims data also showed substantial heparin use. Conclusion: TTS, VTE, and ATE after COVID-19 vaccination were treated similarly to background events. Heparin use post-vaccine TTS suggests most events were not identified as vaccine-induced thrombosis with thrombocytopenia by the treating clinicians.

4.
EClinicalMedicine ; 58: 101932, 2023 Apr.
Article in English | MEDLINE | ID: mdl-37034358

ABSTRACT

Background: Adverse events of special interest (AESIs) were pre-specified to be monitored for the COVID-19 vaccines. Some AESIs are not only associated with the vaccines, but with COVID-19. Our aim was to characterise the incidence rates of AESIs following SARS-CoV-2 infection in patients and compare these to historical rates in the general population. Methods: A multi-national cohort study with data from primary care, electronic health records, and insurance claims mapped to a common data model. This study's evidence was collected between Jan 1, 2017 and the conclusion of each database (which ranged from Jul 2020 to May 2022). The 16 pre-specified prevalent AESIs were: acute myocardial infarction, anaphylaxis, appendicitis, Bell's palsy, deep vein thrombosis, disseminated intravascular coagulation, encephalomyelitis, Guillain- Barré syndrome, haemorrhagic stroke, non-haemorrhagic stroke, immune thrombocytopenia, myocarditis/pericarditis, narcolepsy, pulmonary embolism, transverse myelitis, and thrombosis with thrombocytopenia. Age-sex standardised incidence rate ratios (SIR) were estimated to compare post-COVID-19 to pre-pandemic rates in each of the databases. Findings: Substantial heterogeneity by age was seen for AESI rates, with some clearly increasing with age but others following the opposite trend. Similarly, differences were also observed across databases for same health outcome and age-sex strata. All studied AESIs appeared consistently more common in the post-COVID-19 compared to the historical cohorts, with related meta-analytic SIRs ranging from 1.32 (1.05 to 1.66) for narcolepsy to 11.70 (10.10 to 13.70) for pulmonary embolism. Interpretation: Our findings suggest all AESIs are more common after COVID-19 than in the general population. Thromboembolic events were particularly common, and over 10-fold more so. More research is needed to contextualise post-COVID-19 complications in the longer term. Funding: None.

5.
JMIR Cancer ; 8(3): e39003, 2022 Jul 11.
Article in English | MEDLINE | ID: mdl-35816382

ABSTRACT

BACKGROUND: A cancer diagnosis is a source of psychological and emotional stress, which are often maintained for sustained periods of time that may lead to depressive disorders. Depression is one of the most common psychological conditions in patients with cancer. According to the Global Cancer Observatory, breast and colorectal cancers are the most prevalent cancers in both sexes and across all age groups in Spain. OBJECTIVE: This study aimed to compare the prevalence of depression in patients before and after the diagnosis of breast or colorectal cancer, as well as to assess the usefulness of the analysis of free-text clinical notes in 2 languages (Spanish or Catalan) for detecting depression in combination with encoded diagnoses. METHODS: We carried out an analysis of the electronic health records from a general hospital by considering the different sources of clinical information related to depression in patients with breast and colorectal cancer. This analysis included ICD-9-CM (International Classification of Diseases, Ninth Revision, Clinical Modification) diagnosis codes and unstructured information extracted by mining free-text clinical notes via natural language processing tools based on Systematized Nomenclature of Medicine Clinical Terms that mentions symptoms and drugs used for the treatment of depression. RESULTS: We observed that the percentage of patients diagnosed with depressive disorders significantly increased after cancer diagnosis in the 2 types of cancer considered-breast and colorectal cancers. We managed to identify a higher number of patients with depression by mining free-text clinical notes than the group selected exclusively on ICD-9-CM codes, increasing the number of patients diagnosed with depression by 34.8% (441/1269). In addition, the number of patients with depression who received chemotherapy was higher than those who did not receive this treatment, with significant differences (P<.001). CONCLUSIONS: This study provides new clinical evidence of the depression-cancer comorbidity and supports the use of natural language processing for extracting and analyzing free-text clinical notes from electronic health records, contributing to the identification of additional clinical data that complements those provided by coded data to improve the management of these patients.

6.
Article in English | MEDLINE | ID: mdl-35028799

ABSTRACT

To analyze the prognostic value of left ventricular global longitudinal strain (LV-GLS) and other echocardiographic parameters to predict adverse outcomes in chronic Chagas cardiomyopathy (CCM). Prospective cohort study conducted in 177 consecutive patients with different CCM stages. Transthoracic echocardiography measurements were obtained following the American Society of Echocardiography recommendations. By speckle-tracking echocardiography, LV-GLS was obtained from the apical three-chamber, apical two-chamber, and apical four-chamber views. The primary composite outcome (CO) was all-cause mortality, cardiac transplantation, and a left ventricular assist device implantation. After a median follow-up of 42.3 months (Q1 = 38.6; Q3 = 52.1), the CO incidence was 22.6% (95% CI 16.7-29.5%, n = 40). The median LV-GLS value was - 13.6% (Q1 = - 18.6%; Q3 = - 8.5%). LVEF, LV-GLS, and E/e' ratio with cut-off points of 40%, - 9, and 8.1, respectively, were the best independent CO predictors. We combined these three echocardiographic markers and evaluated the risk of CO according to the number of altered parameters, finding a significant increase in the risk across the groups. While in the group of patients in which all these three parameters were normal, only 3.2% had the CO; those with all three abnormal parameters had an incidence of 60%. We observed a potential incremental prognostic value of LV-GLS in the multivariate model of LVEF and E/e' ratio, as the AUC increased slightly from 0.76 to 0.79, nevertheless, this difference was not statistically significant (p = 0.066). LV-GLS is an important predictor of adverse cardiovascular events in CCM, providing a potential incremental prognostic value to LVEF and E/e' ratio when analyzed using optimal cut-off points, highlighting the potential utility of multimodal echocardiographic tools for predicting adverse outcomes in CCM.

7.
Aten Primaria ; 53 Suppl 1: 102222, 2021 Dec.
Article in Spanish | MEDLINE | ID: mdl-34961582

ABSTRACT

OBJECTIVE: To evaluate the impact of the changes introduced in response to the pandemic on patient-reported patient safety in Primary Care. DESIGN: Prospective observational panel study (health center) based on two cross-sectional surveys. SETTING: 29 Primary Health Care centers from three Spanish health regions (Mallorca, Catalunya Central and Camp de Tarragona). PARTICIPANTS: Random sample of patients visiting their centers before (n=2199 patients) and during the pandemic (n=1955 patients) MAIN MEASUREMENTS: We used the PREOS-PC questionnaire, a validated instrument which assesses patient-reported patient safety in Primary Care. We compared mean scores of the "experiences of errors" and "harm" scales in both periods, and built multilevel regression analyzes to study the variations in patient and center characteristics associated with worse levels of safety. A qualitative (content) analysis of patients' experiences during the pandemic was also performed. RESULTS: The "experiences of errors" and "harm" scales scores significantly worsened during the COVID-19 period (92.65 to 88.81 (Cohen's d=0.27); and 96.92 to 79.97 (d=0.70), respectively). Patient and center characteristics associated to worsened scores were: women, people with a lower educational level, worse health status, more years assigned to the center, and health region. CONCLUSIONS: During the pandemic, a perceptible worsening in patient safety perceived by patients treated in Primary Care has been observed, which has differentially affected patients according to their sociodemographic characteristics or health center profiles.


Subject(s)
COVID-19 , Pandemics , Cross-Sectional Studies , Female , Humans , Patient Reported Outcome Measures , Patient Safety , Primary Health Care , Retrospective Studies , SARS-CoV-2
8.
J Clin Med ; 10(16)2021 Aug 23.
Article in English | MEDLINE | ID: mdl-34442043

ABSTRACT

Whether the increased risk for coronavirus disease 2019 (COVID-19) hospitalization and death observed in Down syndrome (DS) are disease specific or also occur in individuals with DS and non-COVID-19 pneumonias is unknown. This retrospective cohort study compared COVID-19 cases in persons with DS hospitalized in Spain reported to the Trisomy 21 Research Society COVID-19 survey (n = 86) with admissions for non-COVID-19 pneumonias from a retrospective clinical database of the Spanish Ministry of Health (n = 2832 patients). In-hospital mortality rates were significantly higher for COVID-19 patients (26.7% vs. 9.4%), especially among individuals over 40 and patients with obesity, dementia, and/or epilepsy. The mean length of stay of deceased patients with COVID-19 was significantly shorter than in those with non-COVID-19 pneumonias. The rate of admission to an ICU in patients with DS and COVID-19 (4.3%) was significantly lower than that reported for the general population with COVID-19. Our findings confirm that acute SARS-CoV-2 infection leads to higher mortality than non-COVID-19 pneumonias in individuals with DS, especially among adults over 40 and those with specific comorbidities. However, differences in access to respiratory support might also account for some of the heightened mortality of individuals with DS with COVID-19.

9.
Stud Health Technol Inform ; 270: 786-790, 2020 Jun 16.
Article in English | MEDLINE | ID: mdl-32570490

ABSTRACT

Over the last few years, the use of social media mobile applications or apps (SMAs) has increased exponentially. The potential advantages of using these technologies by health professionals in clinical settings have been discussed many times. Considering that the nursing profession is the largest segment of the healthcare workforce in the majority of countries in the world, the impact of using these apps by these professionals is very relevant. The objectives of this study were, firstly, to determine if nurses were using SMAs professionally and the most frequent SMAs used and secondly, to find out if, among nurses, there is a need for training in the use of these mobile applications for professional purposes. The study is a descriptive cross-sectional study based on an Internet survey of 1,293 nurses in Catalonia (Spain). The average age of the respondents who had these apps installed on their mobile phones or tablets, was 43.12 (SD ± 11.32) years old. WhatsApp was the most frequent SMAs used by nurses for professional purposes, and 79.2 % of nurses mentioned they used it several times a day. WhatsApp was the preferred SMAs for communicating with colleagues (31.2% of nurses) followed by Facebook (18.4%) and Twitter (11.3%). In contrast, the use of the SMAs was much less frequent as a means of communication with patients (7.2% in the case of WhatsApp). Nurses expressed their need for specific training in the use of these apps for professional purposes, indicating the interest and potential impact of the introduction of these technologies in clinical environments. The use of SMAs is quite common among nurses at the moment of the survey, and WhatsApp was the most popular one to support their professional activity. Based on the results of the survey, the Nursing Association of Barcelona (COIB) will consider the design of specific training activities in the use of SMAs in clinical settings.


Subject(s)
Social Media , Adult , Cell Phone , Cross-Sectional Studies , Humans , Middle Aged , Mobile Applications , Spain
10.
J Med Internet Res ; 21(6): e14199, 2019 06 27.
Article in English | MEDLINE | ID: mdl-31250832

ABSTRACT

BACKGROUND: Mental disorders have become a major concern in public health, and they are one of the main causes of the overall disease burden worldwide. Social media platforms allow us to observe the activities, thoughts, and feelings of people's daily lives, including those of patients suffering from mental disorders. There are studies that have analyzed the influence of mental disorders, including depression, in the behavior of social media users, but they have been usually focused on messages written in English. OBJECTIVE: The study aimed to identify the linguistic features of tweets in Spanish and the behavioral patterns of Twitter users who generate them, which could suggest signs of depression. METHODS: This study was developed in 2 steps. In the first step, the selection of users and the compilation of tweets were performed. A total of 3 datasets of tweets were created, a depressive users dataset (made up of the timeline of 90 users who explicitly mentioned that they suffer from depression), a depressive tweets dataset (a manual selection of tweets from the previous users, which included expressions indicative of depression), and a control dataset (made up of the timeline of 450 randomly selected users). In the second step, the comparison and analysis of the 3 datasets of tweets were carried out. RESULTS: In comparison with the control dataset, the depressive users are less active in posting tweets, doing it more frequently between 23:00 and 6:00 (P<.001). The percentage of nouns used by the control dataset almost doubles that of the depressive users (P<.001). By contrast, the use of verbs is more common in the depressive users dataset (P<.001). The first-person singular pronoun was by far the most used in the depressive users dataset (80%), and the first- and the second-person plural pronouns were the least frequent (0.4% in both cases), this distribution being different from that of the control dataset (P<.001). Emotions related to sadness, anger, and disgust were more common in the depressive users and depressive tweets datasets, with significant differences when comparing these datasets with the control dataset (P<.001). As for negation words, they were detected in 34% and 46% of tweets in among depressive users and in depressive tweets, respectively, which are significantly different from the control dataset (P<.001). Negative polarity was more frequent in the depressive users (54%) and depressive tweets (65%) datasets than in the control dataset (43.5%; P<.001). CONCLUSIONS: Twitter users who are potentially suffering from depression modify the general characteristics of their language and the way they interact on social media. On the basis of these changes, these users can be monitored and supported, thus introducing new opportunities for studying depression and providing additional health care services to people with this disorder.


Subject(s)
Data Mining/methods , Depression/diagnosis , Linguistics/methods , Mental Health/standards , Social Media/standards , Verbal Behavior/physiology , Depression/psychology , Humans , Language
11.
Bioinformatics ; 34(18): 3228-3230, 2018 09 15.
Article in English | MEDLINE | ID: mdl-29897411

ABSTRACT

Motivation: The study of comorbidities is a major priority due to their impact on life expectancy, quality of life and healthcare cost. The availability of electronic health records (EHRs) for data mining offers the opportunity to discover disease associations and comorbidity patterns from the clinical history of patients gathered during routine medical care. This opens the need for analytical tools for detection of disease comorbidities, including the investigation of their underlying genetic basis. Results: We present comoRbidity, an R package aimed at providing a systematic and comprehensive analysis of disease comorbidities from both the clinical and molecular perspectives. comoRbidity leverages from (i) user provided clinical data from EHR databases (the clinical comorbidity analysis) and (ii) genotype-phenotype information of the diseases under study (the molecular comorbidity analysis) for a comprehensive analysis of disease comorbidities. The clinical comorbidity analysis enables identifying significant disease comorbidities from clinical data, including sex and age stratification and temporal directionality analyses, while the molecular comorbidity analysis supports the generation of hypothesis on the underlying mechanisms of the disease comorbidities by exploring shared genes among disorders. The open-source comoRbidity package is a software tool aimed at expediting the integrative analysis of disease comorbidities by incorporating several analytical and visualization functions. Availability and implementation: https://bitbucket.org/ibi_group/comorbidity. Supplementary information: Supplementary data are available at Bioinformatics online.


Subject(s)
Comorbidity , Data Mining/methods , Electronic Health Records , Software , Databases, Factual , Female , Humans , Male
12.
Stud Health Technol Inform ; 235: 236-240, 2017.
Article in English | MEDLINE | ID: mdl-28423789

ABSTRACT

Comorbid diseases are an important concern in oncology since they can affect the choice and effectiveness of treatment. What is particularly relevant is the fact that the diagnosis of depression in cancer patients has an important impact on the quality of life of these patients. Although there is no consensus about a specific relationship of depression with certain cancer types, some authors have proposed that depression constitutes a risk factor for cancer. The objective of this study is to identify the presence of comorbidities in a massive EHR system, between depression and the 10 most common cancers in women and men and to determine if there is a preferred temporal ordering in the co-occurrence of these diseases. All the cancers studied showed a significant co-occurrence with depression, more specifically, twice more frequent than what could be expected by chance. A preferred directionality was identified between some of the comorbid diseases, such as breast cancer followed by depression, and depression followed by either stomach cancer, colorectal cancer or lung cancer. Future work will address other potential factors that have an influence on the likelihood of suffering from depression in patients with cancer, such as drug therapies received, exposure to substance of abuse or other comorbidities.


Subject(s)
Comorbidity , Depression/epidemiology , Electronic Health Records , Neoplasms/epidemiology , Depression/etiology , Female , Humans , Male , Neoplasms/complications , Neoplasms/etiology , Quality of Life , Risk Factors , Spain/epidemiology
13.
PLoS One ; 11(8): e0160648, 2016.
Article in English | MEDLINE | ID: mdl-27580049

ABSTRACT

Due to the heterogeneity of existing European sources of observational healthcare data, data source-tailored choices are needed to execute multi-data source, multi-national epidemiological studies. This makes transparent documentation paramount. In this proof-of-concept study, a novel standard data derivation procedure was tested in a set of heterogeneous data sources. Identification of subjects with type 2 diabetes (T2DM) was the test case. We included three primary care data sources (PCDs), three record linkage of administrative and/or registry data sources (RLDs), one hospital and one biobank. Overall, data from 12 million subjects from six European countries were extracted. Based on a shared event definition, sixteeen standard algorithms (components) useful to identify T2DM cases were generated through a top-down/bottom-up iterative approach. Each component was based on one single data domain among diagnoses, drugs, diagnostic test utilization and laboratory results. Diagnoses-based components were subclassified considering the healthcare setting (primary, secondary, inpatient care). The Unified Medical Language System was used for semantic harmonization within data domains. Individual components were extracted and proportion of population identified was compared across data sources. Drug-based components performed similarly in RLDs and PCDs, unlike diagnoses-based components. Using components as building blocks, logical combinations with AND, OR, AND NOT were tested and local experts recommended their preferred data source-tailored combination. The population identified per data sources by resulting algorithms varied from 3.5% to 15.7%, however, age-specific results were fairly comparable. The impact of individual components was assessed: diagnoses-based components identified the majority of cases in PCDs (93-100%), while drug-based components were the main contributors in RLDs (81-100%). The proposed data derivation procedure allowed the generation of data source-tailored case-finding algorithms in a standardized fashion, facilitated transparent documentation of the process and benchmarking of data sources, and provided bases for interpretation of possible inter-data source inconsistency of findings in future studies.


Subject(s)
Data Mining/methods , Databases, Factual , Diabetes Mellitus, Type 2/epidemiology , Europe/epidemiology , Female , Humans , Male
15.
Stud Health Technol Inform ; 210: 55-9, 2015.
Article in English | MEDLINE | ID: mdl-25991101

ABSTRACT

Twitter has been proposed by several studies as a means to track public health trends such as influenza and Ebola outbreaks by analyzing user messages in order to measure different population features and interests. In this work we analyze the number and features of mentions on Twitter of drug brand names in order to explore the potential usefulness of the automated detection of drug side effects and drug-drug interactions on social media platforms such as Twitter. This information can be used for the development of predictive models for drug toxicity, drug-drug interactions or drug resistance. Taking into account the large number of drug brand mentions that we found on Twitter, it is promising as a tool for the detection, understanding and monitoring the way people manage prescribed drugs.


Subject(s)
Adverse Drug Reaction Reporting Systems/organization & administration , Natural Language Processing , Pattern Recognition, Automated/methods , Pharmacovigilance , Prescription Drugs/classification , Social Media/statistics & numerical data , Data Mining/methods , Population Surveillance , Terminology as Topic , Vocabulary, Controlled
16.
Stud Health Technol Inform ; 210: 224-6, 2015.
Article in English | MEDLINE | ID: mdl-25991136

ABSTRACT

Most hospitals have already implemented information systems and Electronic Health Records (EHRs), but the reuse of such data for research is still infrequent. We present a pilot project on the exploitation of clinical information from a Spanish hospital database in the context of the European Medical Information Framework project (EMIF). Specific use cases such as patients with diabetes mellitus type 2, obesity and dementia were assessed, by exploiting EHR data integrated from several separated clinical databases. The possibility to analyse the features of specific groups of patients based on their diagnosis codes can provide new data about relationships between different conditions that can contribute for decision-making, healthcare and research.


Subject(s)
Biomedical Research/statistics & numerical data , Data Mining/methods , Electronic Health Records/statistics & numerical data , Information Storage and Retrieval/statistics & numerical data , Medical Record Linkage/methods , Information Storage and Retrieval/methods , Spain
17.
Comput Biol Med ; 43(8): 975-86, 2013 Sep.
Article in English | MEDLINE | ID: mdl-23816170

ABSTRACT

This paper proposes a new methodology for assessing the efficiency of medical diagnostic systems and clinical decision support systems by using the feedback/opinions of medical experts. The methodology behind this work is based on a comparison between the expert feedback that has helped solve different clinical cases and the expert system that has evaluated these same cases. Once the results are returned, an arbitration process is carried out in order to ensure the correctness of the results provided by both methods. Once this process has been completed, the results are analyzed using Precision, Recall, Accuracy, Specificity and Matthews Correlation Coefficient (MCC) (PRAS-M) metrics. When the methodology is applied, the results obtained from a real diagnostic system allow researchers to establish the accuracy of the system based on objective facts. The methodology returns enough information to analyze the system's behavior for each disease in the knowledge base or across the entire knowledge base. It also returns data on the efficiency of the different assessors involved in the evaluation process, analyzing their behavior in the diagnostic process. The proposed work facilitates the evaluation of medical diagnostic systems, having a reliable process based on objective facts. The methodology presented in this research makes it possible to identify the main characteristics that define a medical diagnostic system and their values, allowing for system improvement. A good example of the results provided by the application of the methodology is shown in this paper. A diagnosis system was evaluated by means of this methodology, yielding positive results (statistically significant) when comparing the system with the assessors that participated in the evaluation process of the system through metrics such as recall (+27.54%) and MCC (+32.19%). These results demonstrate the real applicability of the methodology used.


Subject(s)
Decision Support Systems, Clinical , Diagnosis, Computer-Assisted/methods , Feedback , Physicians , Program Evaluation/methods , Humans , Models, Theoretical
19.
J Med Syst ; 36(4): 2471-81, 2012 Aug.
Article in English | MEDLINE | ID: mdl-21537850

ABSTRACT

Automated medical diagnosis systems based on knowledge-oriented descriptions have gained momentum with the emergence of semantic descriptions. The objective of this paper is to propose a normalized design that solves some of the problems which have been detected by authors in previous tools. The authors bring together two different technologies to develop a new clinical decision support system: description logics aimed at developing inference systems to improve decision support for the prevention, treatment and management of illness and semantic technologies. Because of its new design, the system is capable of obtaining improved diagnostics compared with previous efforts. However, this evaluation is more focused in the computational performance, giving as result that description logics is a good solution with small data sets. In this paper, we provide a well-structured ontology for automated diagnosis in the medical field and a three-fold formalization based on Description Logics with the use of Semantic Web technologies.


Subject(s)
Diagnosis, Computer-Assisted , Semantics , Humans , Knowledge Bases , Software Design , Vocabulary, Controlled
SELECTION OF CITATIONS
SEARCH DETAIL
...